be P teh tbe oy ie of) 90 by on 13 P4 
fom ee NE 
hs NEA NUM UL 
"8 ii Tl yet ngiynera tal 33 
om % HA e5 a : i teat ha ie 
= ra rs (oat ee 
+L, ores OS 
taNTa He i 
r ty lt: fe 
“he = beat My e4V iN)! S She 
a emeieta i ie a ot 
is ried 
Seat Mer ION rc a eye ke ri 
: ep ' i 
. ro inn 
F Bee sy, “iy 
° ae 
: ic ‘ C $3 “4 
: i zi es 
}- aya : “he 
i fe HI 


ae 


vee 
* 


oe 
’ 


a ele 
Pe 
L* 5 
Se Vd, 
fo NS 


ar 
poe a | 


Pe ae 


i 


ie 
e 


- 
met oe pa 


SS 


to pee ne 
a 
ae 


eo * 
A) set 


: 
© 

—> 
= or: 


Et< 
Le 
ra) 


a 
eame ae SD 


cf, 


ay a abtank 

Pt) rate i 4 te ; 

fT niin Hen ah 

ji Satin ly ts ye eS ss " 
Tn aes By, Dyer tas 
OW 

Hn} 

fie 
ke 


Repent 
= 
ce hf 


*) 
eeeets 


eT ae 
= 
a 


= 
te 


=~ 
— 
<a 


fa 
a 
<a 


as 
are 
men = ty 


a 


VALUE ANALYSIS: 


Justifying Decision Support Systems 


Peter G. W. Keen 


October 1980 


64 
1160-80 


CISR No. 
Sloan WP No. 


Center for Information Systems Research 


Massachusetts Institute of Technology 
Alfred P. Sloan School of Management 
50 Memorial Drive 
Cambridge, Massachusetts, 02139 


617 253-1000 


VALUE ANALYSIS: 


Justifying Decision Support Systems 


Peter G. W. Keen 


October 1980 


CISR No. 64 
Sloan WP No. 1160-80 


CONTENTS 


Introduction. . 


Decision Swjysecte SSE oo 6 0 6 O86 6 oo 6 oo 6 


The Dynamics of Innovation ..... Se ne eae 


Methodologies for Evaluating Proposals .......- 


Value Analysis . 


Table l 


Figure 1 


Examples of DSS Applications 

IFPS Development Process 

Relative Use of DSS Operators (PMS) 
DSS Benefits 

Dynamics of Innovation 

Dynamics of DSS Innovation 


Value Analysis 


THO8S7 


18 


22 


26 


1. Introduction 


Decision Support Systems (DSS) are designed to help 
improve the effectiveness and productivity of managers and 
professionals. They are interactive systems frequently used by 
individuels with little experience with computers and analytic 
methods. They support, rather than replace, judgement in that ener 
do not automate the decision process nor impose a sequence of analysis 
Bnethcusere Au Dooe 1s imeestect, a seatt assistant to whom the 
manager delegates activities involving retrieval, computation and 
reporting. The manager evaluates the results and selects the next 


step in the process. Table 1 tacts typrcaleDSs applications. ! 


fraditional cost-benefit analysis is not well-suited to DSS. 
The benefits they provide are often qualitative; examples cited by 
users of DSS include the ability to examine nee alternatives, stimu-~ 
lation of new ideas and improved communication of analysis. It is 
extraordinarily difficult to place a value on these. In addition, 
most DSS evolve. There is no "final" system; an initial version is built 
and new Zacilities added in response to the users’ experience and 
learning. Because of this, the costs of the DSS are not easy to iden-~ 


Gittye 


The decision to build a DSS seems to be based on value, 
rather than cost. The system represents an investment for future 
effectiveness. A useful analogue is management education. A company 
will sponsor a five-day course on strategic planning, organizational 
development or management control systems on the basis of perceived 
mecd or long-term value. There is no attempt to look at payback 
period or ROI, nor does management expect a direct improvement in 


earnings per share. 


This report examines how DSS are justified and recommends 
Value Analysis (VA), an overall methodology for planning and evaluat- 
ing DSS proposals. Section 2 illustrates applications of DSS. Key 


points are: 


1) A reliance on prototypes 
2) The absence of cost-benefit analysis 
3) The evolutionary nature of DSS development 


4) The nature of the perceived benefits 


Section 3 relates DSS to other types of innovation. It 
seems clear that innovation in general is driven by "demand-pull" 


-response to visible, concrete needs- and not "technology push". 


Section .4 briefly examines alternative approaches to evalu- 
ation: cost-benefit analysis, scoring techniques and feasibility 
studies. They all require fairly precise estimates of and trade-offs 
between and benefit and often do not handle the qualitative issues 
central to DSS development and innovation in general. The final 


part of the report defines Value Analysis. 


The overall issue the paper addresses is a managerial one: 
1) What does one need to know to deererie it is worthwhile building 
el WSIS 2 | 
2) How can executives encourage innovation while making sure money 
is well spent? 
3) How can one put some sort of figure on the value of effectiveness, 


learning or creativity? 


It would be foolish to sell a strategic planning course for 
executives on the basis of cost displacement and ROI. Similarly, any 
effort to exploit the substantial opportunity DSS provide to help 
Managers do a better job must be couched in terms meaningful to them. 
This requires a focus on value and a recognition that qualitative 
benefits are of central relevance. At the same time, systematic 
assessment is essential. The initial expense of a DSS may be only 


in the $10,000.00 range but this still represents a significant 


commitment of funds and scarce programming resources. The methodology 

proposed here is based on a detailed analysis of the implementation of 

over twenty DSS. It is consistent with the less formal approaches most 
managers seem to use in assessing technical innovations. Value 


analysis involves a two~stage process: 


1) Version 0: This is an initial, small-scale system which 
is complete in itself but may include limited functional 
Capability. ine decision to build Version 0 is based on: 
a) An assessment of benefits, not necessarily quantified; 
b) Acost threshold -- is it worth putting at risk this 

amount of money to get these benefits? 

In general, only a few benefits will be assessed. _ The cost 
threshold must be kept low, so that this decision can be 
viewed as a low-risk research and development venture and 


not a capital investment. 


2) Base System: This is the full system, which will be 
assessed if the tiral Version 0 has successfully 
established the value of the proposed concept. 


The decision to develop it is based on: 


a) Cost analysis: what are the costs of 
building this larger system? 
b) Value threshold: what level of benefits is 
needed to justify the cost? What is the Teeetinesa 


of this level being attained? 


A major practical advantage of this two-stage strategy is that 
it reduces the risks involved in development. More importantly, it 
simplifies the trade-off between costs and benefits, without making 
the analysis simplistic. It is also a more natural approach than 
traditional cost-benefit analysis; until value is established, any 


cost is disproportionate. 


2. Decision Support Systems 


The DSS applications shown in Table 1 cover a range of 


functional areas and types of task. They have many features in common: 


1) They are non-routine and involve frequent ad hoc 
analysis, fast access to data, and generation of non- 
standard reports 

2) They often address "what-if?" questions: for example, 
"what if the interest rate is x3?" or “what if sales 
are 10% below the forecast?” 

3) They have no obvious correct answers; the manager has 
to make qualitative trade-offs and take into account 


situational factors. 


The following examples illustrate these points: 

1) GADS: in designing school boundaries, parents and 
school officials worked together to resolve a highly- 
charged political problem. A proposal might be reject- 
ed because it meant closing a particular school, having 
children cross a busy highway or breaking up neighborhood 


groups. In a previous effort involving redistricting, only 
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one solution had been generated, as opposed to 6 with 
GADS over a 4-day period. The interactive problem- 
solving brought out a large number of previously 
unrecognized constraints such as transportation patterns 
and walking times and parents’ feelings. 

2) BRANDAID: a brand manager heard a rumor that his 
advertising budget would be cut in half. By 5 pm he had 
a complete analysis of what he felt the effect would be 
on this year's and next year's sales. 

3) IFPS: A model had been built to assess a potential 
aquisition. A decision was needed by 9 am. The 
results of the model suggested the acquisition be made. 
The senior executive involved felt uneasy. Within one 
hour, the model had been modified and "what if" issues 
pesaosed that led to rejection of the proposal. 

4) ISSPA and IRIS: data which had iaavs been available 
but not accessible were used to answer ad hoc, simple 


questions. Previously no one bothered to ask them. 
These characteristics of problems for which DSS are best 


suited impose design criteria. The system must be: 


1) Flexible to handle varied situations 


ae 


2) Easy to use so it can be meshed into the manager's 
decision process simply and quickly 

3) Responsive: it must not impose a structure on the 
user and must give speedy service 

4) Communicative: The quality of the user-DSS dialogue 
and of the system outputs are key determinants of 
effective uses especially in tasks involving 
communication or negotiation. Managers will use computer 
systems that mesh with their natural mode of operation. 
The analogy of the DSS as a staff assistant is a useful 


one. 


Many DSS rely on prototypes. Since the task the system 
supports is by definition non-routine, it is hard for the user to 
articulate the criteria for the DSS and for the designer to build 
functional specifications. An increasingly popular strategy is thus 
to use a langauge such as APL, an application generator or end-user 
language. These allow an initial system to be delivered quickly and 
cheaply. It provides a concrete example that the user can react to and 
learn from. It can be easily expanded or modified. The initial system, 
Version 0, clarifies the design criteria and specifications for the full 


DSS. Examples of this two-phase strategy include: 


1) ISSPA: built in APL. Version 0 took 70 hours to 
build and contained 19 commands. The design process 
began by sketching out the user-system dialogue. New 
user commands were.added as APL functions. 10 of the 
48 commands were requested by users and several of the 
most complex ones entirely defined by users. 

2) AAIMS: an APL-based "personal information system" 
for analysis of 150,000 time series. The development 
was not based on a survey of user requirements nor on 
any formal plan. New routines are tested and "proven" 
by a small user group. 

3) IRIS: a prototype was built in 5 months and evolved over 
a one year period. An "Executive langauge" interface was 
defined as the base for the DSS and a philosophy adopted 
of "build and evaluate as you go". 

4) CAUSE: There were 4 evolutionary versions; a phased 
development was used to build credibility. The number 


of routines were expanded from 26 to 200. 


There have been several detailed studies of the time and 


cost needed to build a DSS in APL. A usable prototype takes about 3 


weeks to deliver. A full system requires another 12-16 weeks. 2 


End-user langauges similarly allow fast development. 
One such DSS "generator" is Execucom's IFPS (Interactive Financial 
Planning System) » a simple, English-like language for building 
strategic planning models. The discussion below is based on a survey 
of 300 IFPS applications in 42 sonseiooee The models included long- 
range planning, budgeting, project analysis, evalution of mergers and 


aquisitions. 


The average IFPS model took 5 days to puild and contained 
360 lines (the median was 200). Documented specifications were 
developed for only 16%. In 66% of the cases, an analyst simply 
responded to a manager's request and got something up and running 
quickly. Cost —benerit analysis was done for 13% and only 30% have 
any objective evidence of "hard" benefits. 74% of the applications 
replace manual proceedures. (Given that most of the responding 
companies are in the Fortune 100, this ee the limited degree 
to which managers in the planning funcitons make direct use of 


computers: ) 


Most DSS are built outside data processing, generally by 
individuals who are knowledgeable about the application area. Table 2 
gives figures on where requests for IFPS applications came from and 


how they are built. 
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Table 2 IFPS Development Process 


Who requested 
the application 


Who built it 


Who uses the 
terminal 


Who uses the 
output 


Data 
Processing 


Staff 
Analyst 


53 


‘70 


Middle 
Management 


30 


22 


ea 


42 


Top 
Management 


66 


a2 


52 


The IFPS users were asked to identify the features of the 


language that contributed most to the success of the DSS. In order 


of importance, these are: 


1) 
Zz) 
3) 
4) 


5) 


Speed of response 

Ease of use 

Package features (curve-fitting, risk analysis, what-if?) 
Sensitivity analysis 


Time savings 


The evolutionary nature of DSS development follows from the 


reliance on prototypes and fast development. There is no “final" system. 


In most instances, the system evolves in response to user learning. A 


major difficulty in designing DSS is that many of the most effective uses 


are unanticipated and even unpredictable. Examples are: 


1) 


Za) 


3) 


PMS: theintended use was to Peeiteace a portfolio-based 
rather than security-based approach to investment. This 

did not occur, but the DSS was invaluable in communicating 
with customers. 

GPLAN: the DSS forced the users (engineers) to change their 
roles from analysts to decision makers. 

PROJECTOR: the intended use was to analyze financial data 

in order to answer preplanned questions and the actual use was 


as an educational vehicle to alert managers to new issues. 


slike 


Table 3 Relative Use of DSS Operators (PMS) 


percentage of use by each manager 


percentage of use 
A B € D E ie by all users 


DIRECTORY 


Usage is also very personalized, since the managers differ in 
their modes of analysis and the DSS is under their own control. For 
example, 6 users of PMS studied over a 6 month period differed strongly 


in their choice of operators (See Table 3). 


The benefits of DSS vary; this is to be exptected given the 
complex situational nature of the tasks they support and their personalized 
uses. The following list shows those frequently cited in DSS case studies, 


together with representative evinces Table 4 summarizes the list. 


1) Increase in the number of alternatives examined: 

- sensitivity analysis takes 10% of the time needed 
previously 

- 8 detailed solutions generated versus l in previous study 

~ previously took weeks to evaluate a plan; now takes 
minutes, so much broader analysis 

- users could imagine solutions and use DSS to test out 
hypotheses 


-~ "no one had bothered to try price/profit options before" 


2) Sbetker understanding of the business 
- president made major changes in company's overall plan, 


after using DSS to analyze single acquisition proposal 
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3) 


4) 


DSS alerted managers to fact that an apparently success-~ 
ful marketing venture would be in trouble in six month's 
time 

DSS used to train managers; gives them a clear overall 
picture 


"now able to see relationships among variables" 


Fast Response to unexpected situations 


a marketing manager faced with unexpected budget cut used 

the DSS to show that this would have a severe impact later 
helped develop legal case to remove tariff on petroleum in 
New England states 

model revised in 20 minutes, adding risk analysis; led to 


reversal of major decision made 1 hour earlier 


Ability to carry out ad hoc analysis 


50% increase in planning group's throughput in 3 years 
the governor's bill was published at noon "and by 5 pm I 
had it fully costed out" 

"I can now do QAD's: quick-and-dirties" 

system successfully used to challenge legislator's 


statements within a few hours 


See 


5) New insights and learning 


- quickened management's awareness of branch bank 
problems 


- gives a much better sense of true costs 


identified underutilized resources already at analyst's 
disposal 


~ allows a more elegant breakdown of data into categories 
heretofore impractical 


stimulated new approaches to evaluating investment 


proposals 


6) Improved communication 


- used in "switch presentations" by advertising agencies 
to reveal shortcomings in customer's present agency 


can explain rationale for decision to investment clients 


improved customer relations 


“analysis was easier to understand and explain. Manage- 


ment had confidence in the results". 


"it makes it a lot easier to sell (customers) on an idea 


1 


7) Control 
~ permits better tracking of cases 
- plans are more consistent and management can spot 


discrepancies 


== 


- can "get a fix on the overall expense picture" 

~ standardized calculation procedures 

- improved frequency and quality of annual account 
reviews 


- better monitoring of trends in airline's fuel consumption 


8) Cost savings 
~ reduced clerical work 
- eliminated overtime 
- stay of patients eer e ne 


- reduced turnover of underwriters 


9) Better decisions 

~ "he was forcedto think about issues he would not have 
considered otherwise" 

- analysis of personnel data allowed management to identify 
for the first time where productivity gains could be 
obtained by investing in office automation 

~ increased depth and sophistication of analysis 


- analysts became decision-makers instead of form preparers 


10) More effective team work 


- allowed parents and school administrators to work together 


exploring ideas 
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8) 


aL)) 


reduced conflict: managers could quickly look at proposal 


without prior argument 


Time savings 


planning cycle reduced from 6 man-days spread over 20 
elapsed days to 1/2 a day spread over 2 days 
“substantial reduction in manhours" for planning studies 


(my) time-effectiveness improved by a factor of: 20" 


Making better use of Gata resource 


experimental engineers more ready to collect data since 
they knew it would be = es into a usable system 
“more cost-effective than any other system (we) 
implemented in capitalizing on the neglected and wasted 
resource of data" 


allows quick browsing 


-"puts tremendous amount of data at manager's disposal in 


form and combinations never possible at this speed". 


Table 4 adds up to a definition of managerial productivity. 


All the benefits are valuable but few of them quantifiable in ROI or 


payback terms. 


Ge 


Tabie 4 - DSS Benefits 


benefit can be 


Easy to quantified ina 
measure? "bottom line” figure? 
cei Seal aoe Lo eee aoe 
1. Increase in number of alternatives M¢ N 
examined 
2. Better understanding of the N N 
business 
3. Fast response to unexpected Y N 
situations 
4. Ability to carry out ad hoc M N 
analysis 
5. New insights and learning N N 
6. Improved communication N NN 
ee COMtron: N N 
8. Cost savings Y Y 
9. Better decisions , N N 
10. More effective teamwork N N 
11. Time savings Mg Y 
12. Making better use of data M N 


resource 


In few of the DSS case studies is there any evidence of 
formal cost-benefit analysis. In most instances, the system was built 
in response to a concern about timeliness or scope of analysis, the need 
to upgrade management skills, or the potential opportunity a computer 
Gata resource or modelling capability provides. Since there is little 
a priori definition of costs and benefits, there is litttle a posteriori 
assessment of gains. A number of DSS failed in their aims; but where 
they are successful, there is rarely any formal analysis of the 
returns. Many of the benefits are not proven. In managerial tasks 
there is rarely a clear link between decisions and outcomes, and a DSS 
can be expected to contribute to better financial performance but not 
directly cause it. In general, managers describe a successful DSS as 


"indispensable" without trying to place an economic value on it. 
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3. The Dynamics of Innovation 


DSS are a form of innovation. They represent: 

1) A relatively new concept of the role of computers in 
the decision process; 

2) An explicit effort to make computers helpful to 
Managers who on the whole have not found them 
relevant to their own job, even if they are useful 
to the organization as a whole; 

3) A decentralization of systems development and 
operation and often a bypassing of the data processing 
department; 

4) The use of computers for "value-added" applications 


rather than cost displacement. 


There is a large literature on the dynamics of technical 
innovations in ereanizateode.! Its conclusions are fairly uniform 


and heavily backed by empirical data. Table 5 lists some key 


findings. 
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Table 5 


Dynamics of Innovation 


Innovations are 1) value driven 


2) a response to a 
perceived problem 


Early adopters differ from later ones 


in that they are iconoclastic 
entrepreneurs willing to accept 
risk 


Informal processes are central to 


innovation and they require 
1) gatekeepers 


2) product champions 


New applications come from the 
marketplace, not from 
technologists 


Cost is a seconda issue in innovation 


Uncertainty is reduced by "trialability", 


ease of understanding and clear 
performance value 


References 


Utterback, 
Rogers & Shoemaker, 
von Hippel 


Haug, Roberts 


Allen, Rogers, 
Chakrabarti 


Utterback, 
von Hippel 


Haywood 


Rogers & Shoemaker 


Surveys of the use of computer planning models support 
these conclusions. In nine cases sexthied dhe decision to adopt 
planning models was based on: 

1) Comparison with an ongoing system; this involves 
examining either a manual or partially computerized 
system and deciding that some change is desirable; 

2) Comparison with a related system, such as a successful 
Planning model in another functional area; 

3) Initiation of a low-cost project; 

4) Comparison with competitors' behavior; this use of 
a "reference model” reduces the need to estimate 
the impact of a model not yet constructed on 


improved decisions and performance. 


Even in traditional data processing applications, the 
emphasis on value rather than cost is common. A survey of all the 
proposals for new systems accepted for development in a large 
multinational company found that even though cost-benefit analysis 
was formally required, it was used infrequently. The two main 
reasons for implementing systems were: 


1) Mandated requirements, such as regulatory reports; 


oe 


2) Identification or one or two benefits, rarely 


quantified. 


Traditional cost-benefit analysis is obviously effective 
for many computer-based systems. It seems clear, however, that it 
is not used in innovation. This may partly be because innovations 
involve R&D; they cannot be predefined and clear specifications 
provided. There is some evidence that there is a conflict in 
organizations between groups concerned with performance and those 
focused on cost. In several DSS case studies, the initiators of 
the system stress to their superiors that the project is an 


investment in R&D, not in a predefined product. 


Surveys of product innovations consistently find that 
they come from customers and users, rather than centralized 
technical or research staff. Well over three-quarters of new 
products are initiated by someone with a clear problem looking for 
a Solera: Industrial salesmen play a key role as "gatekeepers" 
bringing these needs to the attention of technical specialists. 
Even in the microprocessor industry, the majority of products are 


stimulated in this way by "demand-pull" not by "technology-push”. 


Oe 


Case studies indicate that DSS development reflects the 


same dynamics of innovation as in other technical fields. Table 6 


restates Table 5 in relation to DSS. 
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Table 6 


Dynamics of DSS Innovation 


Innovations are value-driven 


Early adopters differ from late 
adopters 


Informal processes are central 


Cost is a secondary issue 


Uncertainty reduced by 
trialability, ease of 
understanding, clear 
performance value 


Main motivation for DSS is "better" 
planning, timely information, 
ad hoc capability, etc. 


DSS are often initiated by line 
managers in their own budgets; 
once the system is proven other 
departments may pick it up. 


DSS development usually involves 4 
small team; key role of 
intermediaries knowledgeable 

about the users and the technology 
for the DSS; data processing 

rarely involved; frequently DSS are 
“bootleg” projects. 


Costs are rarely tracked in 
detail; D8S budget is often 
based on staff rather than 
dollars; little charge cut of 
systems (this may reflect item 
below) . 


Use of prototypes; emphasis on 
ease of use. 


4. Methodologies for Evaluating Proposals 


There are three basic techniques used to evaluate proposals 
for computer systems in most organizations: 
1) Cost-benefit analysis and related ROI approaches; 
this views the decision as a capital investment; 
2) Scoring evaluation; this views it in terms of 
weighted scores; 


3) Feasibility study; this views it as engineering. 


Each of these is well-suited to situations that involve 
hard costs and benefits and that permit clear performance criteria. 
They do not seem to be useful -- or at least used -- for evaluating 


innovations or DSS. 


Cost-benefit analysis is highly eansitive to assumptions 
such as discount rates and residual value. It needs seekeieiel and 
often arbitrary modifications to handle qualitative factors such as 
the value of improved communication and improved job satisfaction. 
Managers seem to be more comfortable thinking in terms of perceived 
value and then asking if the cost is reasonable. For example, 


expensive investments on training are made with no effort at 
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quantification. The major benefits of DSS listed in Table 4 are 
mainly qualitative and uncertain. It is difficult to see how 
cost-benefit analysis of them can be reliable and convincing in 


this context. 


Scoring methods are a popular technique for evaluating 
large-scale technical projects, such as the choice of a 
teleconmunications package, especially when there Bes multiple 
proposals with varying prices and capabilities. Scoring techniques 
focus on a list of desired performance characteristics. Weights are 


assigned to them and each alternative rated. For example: 


score for weighted 
characteristic weight alternative score 
response time asi0) 15 4.5 
ease of use , 5a) 20 4.0 
user manual 10 17 the d 


Composite scores may be generated in several ways: mean 
rating, pass-fail, or elimination of any alternative that does not 
meet a mandatory performance requirement. Cost is considered only 
after all alternatives are scored. There is no obvious way of 


deciding if alternative A with a cost of $80,000 and a composite 


Oe 


score of 67 is better than B witn a cost of $95,000 and a score of 79. 


Feasibility studies involve an investment to identify 
likely costs and benefits. They tend to be expensive and to focus 
on defining specifications for a complete system. They rarely 
give much insight into how to build it and assume that the details 
of the system can be laid out in Advances DSS prototypes are a form 
of feasibility study in themselves. They are a first cut at a 
system. Some designers of DSS point out that Version "0" can be 
literally thrown away. Its major value is to clarify design criteria 
and establish feasibility, usefulness, and usability. The differences 


between a prototype and a feasibility study are important: 


1) The prototype moves the project forward, in that a 
basic system is available for use and the logic and 
structure of the DSS already implemented; 

2) The prototype is often cheaper, if the application is 
suited to APL or an end-user language; 

3) The feasibility study is an abstraction and the 
prototype concrete; since DSS uses are. often 
personalized and unanticipated, direct use of the DSS 


may be essential to establishing design criteria. 
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There is no evidence that any of these methods are used in 
evaluating DSS, except occasionally as a rationale or a ritual. 
More importantly, almost every survey of the dynamics of innovation 


indicates that they do not facilitate innovation and often impede it. 
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5. Value Analysis, 


The dilemma managers face in assessing DSS proposals is that 
the issue of qualitative benefits is‘central but they must find some 
way of deciding if the cost is justified. What is needed is a 
systematic methodology that focuses on: 

1) Value first, cost second; 

2) Simplicity and robustness; decision makers cannot 

(and should not have to) ee precise estimates of 
uncertain, qualitative future variables; 

3) Reducing uncertainty and risk; 


4) Innovation, rather than routinization. 


The methodology recommended here addresses all these 

issues. It relies on prototyping which: 

1) Factors risk, by reducing the initial investment, 
delay between approval of the project and delivery 
of a tangible product; 

2) Separates cost and benefit, by keeping the initial 
investment within a relatively small, predictable 


range. 
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If an innovation involves a large investment, the risk is 
obviously high. Since estimates of costs and benefits are at best 
approximate, the decision maker has no way of making a sensible 
judgement. Risk is factored by reducing scope. An initial system 
is built at a cost below the capital investment level; the project 
as then an R&D effort. If scan be written Grif if it fails. By wsing the 
DSS one identifies benefits and establishes value. The designer is 
also likely to learn something new about how to design the full 
system. The prototype accomplishes the same things as a feasibility 


study, but goes further in that a real system is built. 


The benefits of a DSS are the incentive for going ahead. 
The complex calculations of cost-benefit analysis are replaced in 
value analysis by simple questions that most managers naturally ask 
and handle with ease: 
1) What exactly will I get from the system? 
-- It solves a business problem; 
-- It can help improve planning, communication 
and control; 
-- It saves time. 
2) Xf the prototype costs $X, do I feel that the cost 


is acceptable? 
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Obviously the manager can try out several alternatives; 
"If the prototype only accomplishes two of my three operational 
objectives, at a lower cost of $Y, would I prefer that?" The key 
point is that value and cost are kept separate and not equated. 
This is sensible only if the cost is kept fairly low. From case 
studies of DSS, it appears that the cost must be below $20,000 in 
most organizations for value analysis to be applicable. 

This first stage of value analysis is similar to the way 
in which effective decisions to adopt tmiovations are made. 
It corresponds to most managers' implicit strategy. The second stage 
is a recommendation; there is no evidence in the literature that it 
is widely used, but it seems a robust and simple extension of 
Version "0". Once the nature and value of the concept has been 
established the next step it to build the full DSS. The assessment 
of cost and value needs now to be reversed: 

1) How much will the full system cost? 

2) What threshold of values must be obtained to 

justify the cost? What is the likelihood they 


will occur? 


If the expected values exceed the threshold, no further 


quantification is required. If they do not, then obviously there 
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must either be a scaling down of the system and a reduction in cost 


or a more detailed exploration of benefits. 


Value analysis follows a general principle of effective 
decision making -- simplify the problem to make it manageable. 
A general weakness of the cost-benefit approach is that it requires 
knowledge, accuracy and confidence about issues which for innovations 
Are unknown, ill-defined and uncertain. it therefore is more feasible to 

1) Establish value first, then test if the expected 

cost is acceptable. 
2) For the full system, establish cost first then test 


if the expected benefits are acceptable. 


Instead of comparing benefits against cost, value analysis 
involves merely identifying relevant benefits and testing them 
against what is in effect a market price: “Would I be willing to 
pay $X% to get this capability?" It is obviously essential that the 
benefits be accurately identified and made operational. “Better 
planning" is not operational. The key question is how would one know 
that better planning has occurred? The prototype is in effect an 


experiment in identifying and assessing it. 
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FIGURE 1 VALUE ANALYSIS 


ESTABLISH VALUE: 


Define operational list of benefits: 
e.g., solves urgent business problem 
provides a flexible tool for recurrent analysis 
makes planning data quickly accessible 
saves time in recurrent ad hoc reporting 


a 


‘DETERMINE COST THRESHOLD: 


Define maximum one would be ready to pay 
to gain the benefits 
Determine if a prototype can be built 


(gon es that delivers the necessary capabilities 


BUILD VERSION O: 
Define an architecture that permits the full 
system to be evolved from the initial version 0 
Define routines for prototype 


™ 


ASSESS PROTOTYPE: 
Review benefits; revise and extend list 
Review desired and obtainable capabilities 
Define functional capabilities of full 
system 


ESTABLISH COST OF VERSION 1: 


How much will the full system cost? 


DETERMINE BENEFIT THRESHOLD: 


What level of benefits must be obtained 
to justify the investment in the full 
system? 

What is the likelihood these can be ob- 
tained? 


L 


BUILD VERSION O 
EVOLVE VERSION N 
Review usage, evaluate new capabilities 
desired or obtainable 


BS tableushnmeosie 
Determine benefit threshold 
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Figure 1 illustrates the logic and sequence of value 
analysis. The specific details of the Pe ehod are less important than 
the overall assumptions, which have important implications for anyone 
trying to justify a DSS whether as a designer or user. Marketing a 
DSS requires building a convincing case. Figure l can be restated 
in these terms: 

1) Establish value; the selling point for a Dss) is ete 
specific benefits it provides for busy managers in 
complex jobs. 

2) Establish cost threshold; "trialability” is possible 
only if the DSS is relatively cheap and installed 
Gyulehalky, IF abe GeseS, SEM, §200,000, it is a 
capital investment, and must be evaluated as such. 
This removes the project from the realm of R&D and 
ee as the focus of attention to ROI and tangible 
costs and inhibits innovation. 

3) Build Version "O"; From a marketing perspective this 
is equivalent to "strike while the iron she JeVONe 
Doing so is possible only with tools that allow speedy 
Gevelopment, modification and extension. 

4) Assess the prototype; for the marketer this means 
working closely with the user and prcviding responsive 


service. 
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Two analogies for DSS have been mentioned in this report: 
The staff assistant and management education. The strategy used to 
justify DSS depends upon the extent to which one views such systems 
as service innovations and investments in future effectiveness as 
opposed to products, routinization and investment in cost displacement 
and efficiency. The evidence seems clear -- DSS are a potentially 
important innovation. Value is the issue, and any exploitation of 
the DSS approach rests on a systematic strategy for identifying 


benefits, however qualitative, and encouraging R&D and experimentation. 
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REFFRENCES 


1. Detailed descriptions of each DSS shown in Table 1 can be found in 
the relative reference: 


GADS: Keen & Scott Morton, Carlson & Sutton 
PMS: Keen & Scott Morton, Andreoli & Steadman 
IRIS: Berder & Edelman in Carlson (ed.) 
PROJECTOR: Keen & Scott Morton, Meador & Ness 
IFPS: Wagner 
ISSPA: Keen & Gambino 

' BRANDAID: Keen & Scott Morton, Little 
IMS: Alter 


Other DSS referred to in this paper are: 
AAIMS: Kless in Carlson (ed.), Alter 


CAUSE: Alter 
GPLAN: Haseman in Carlson (ed.) 


2. See Grajew & Tolovi for a substantiation of these figures. They built 
a number of DSS in a manufacturing firm to test the “evolutive 
approach" to development. 


3. FPS is a proprietary product of Execucom, Inc., Austin, Texas. 
The survey of IFPS users is described in Wagner. 


4. See Andreoli & Steadman for a detailed analysis of PMS usage. 


5. This list (pp. 12-16) is taken verbatim from Keen "Decision Support 
Systems and Managerial Productivity Analysis". 


6. See bibliography to the National Science Foundation working draft 
"Innovation Processes and their Management: A Conceptual, Empirical, 
and Policy Review of Innovation Process Research" by L.G. Tornatzky, 
et al., October 19, 1979. 


7. See Blanning, "How Managers Decide to Use Planning Models", Long Range 
Planning volume 12, April 19380. 


8. See Ginzberg. 
9. See Utterback. 


10. See von Hippel. 
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